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PREFACE ^ . I 
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of the Asslitant Segretsry of Defense ttanpower & Reserve Affaira, v 
Colonel' George |, Tllaon, Director for Tralnlngi served as Con- 
tract Technical 

The,Tesaareh was eonducced by ^^ot^RO Weitem Dlvisioti" at. , 
Carael^ California; Dr* fioward H. MaFwan, Dlreator.\ The , Principal 
Investigator for the\e8eareh was Dr, Burl B. Gray, \ ^ 

The research team included Dr. John E* Taylor, frho served 
as Pro j eat Coordinator and contributed to all phases of the re-^ 
search and writing of the final report p apd Hiss Wendy J. McGulrej 
who was ^responsible for project operations* Including questionnaire 
mailing, telephone interviews , and data collection, Mrs. M^urlalne 
Jorgenson was responsible or the overayf ^preparation oir the final 
report manuscript^ * . ^ ^ 

The resea^h team vould like to ekpress its appreciation 
to the peopA from both the military and civilian schools, whose 
response, to the qi^^tlonnalr^ and telephony Interviews provided 
the data , base for this reseaVc^ project* Mso/ they would llke^ 
to acknowledge the efforts of Ms 'J^annie Fltes and LTC L,G. Junkmanri 
froiii the OASD(M^RA) offices whosm assistance contributed to the out- 
come of this project, ^ ' \ 



TABLE OF CONTENTS 



* ' * * 



srooiART . . . \ . 

' IKraODUCTIOT , . , ,. . 

. BffiTHOD , . . , ... 

Apprdaeh • . . . . 
Cta^ganliatlotfi Quarled . 

Datad^^ojilv^ . . . 
Data i^k\jmi.B .. . . 

ElSin.TS h DISCUSSION . , . 

Han^gsaant .-^ , ^ . 
Conduc^t ot* Inacructiofi 
Evalu^Uon .... 
^ poat^^ Allocations 

SinglLa Course ^alysis • . . 
Concludiiig Ramarks . » . i . 

- - I ■ ■ ■ 

REFEKNCES ,. - . . . . . . . . 

APPENDIX - JOB-TRAINIKG^^ESTIONMIRE 



• • • ■ • 



. ■ . . . 



■ 9 



m c 



* ■ 



ILLUSTRATIONS 



1 * Mean Student /Instructor Ratio 



Ha4li An^iual Graduatej^nstructo 
Main Percentf^of l^ort-Lactura Timi 



. • . 



m m 



9 . 




V. 



i 



6 



. 1 
,* ./ 1 



9 

11 
2 
13 
15 



16 

16 

23 
27 
30 
30 
45 

47 




ERIC 



6' 



- * • 



PURPOSE 



SllMMARYv^" . . ' . /-^ 



I. 

1 



This study wms condu&ted to gather' In^depth comparatlva data on 
Job'^ti'aiiilng ptactlcss Aross DOP sehoels, business mod Industry, 
proprietary trade end teehnlael sehooli, >taJor Intereit was in^inform- 
etloQ OQ the mli^ag^ent,^^eraduet p and^cost of such trainlnst^ ' ' 
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METHOD. 



^ Twelve high^dfnslty job traj^nin^ eourees in both the mllltaiy and 
eivillan sectors were selected for , study* Det^led questionnaires were 
sent to' the training direQtors/mana^eri of a selected sample military 
and clvjLlian or^nlzations involved in Job training. Qusatlon^lrea wer% 
sent tof , 33y trade At^^hnical schools , 29 corgmerclal coTppanies/industries / 
institutions, and' 2p POD schools (9 Army, 4 Marine Corps, A Air FoBce, and 
3 Navy)* Of a total of 134 questlnnnaires sent, J5 wetes^eturned* Of 
thes*^ 24 from DOD schools and 17 trade/technical schools c^niained useabl 
datf « No commercial companies provided data, all reporting that they do 
not train in these courses, 

- ' " ' ' ' I ' • 

The. data oi^ the returned questionnaires were eubjejcted to descriptive 
analysis and a cbmparison of practices between DOD schools and trade/tech^ 
nical s^qpla was made. . » V ' 

■ ■ . ■ ; 

FINDINGS^ . ^ ^ 

The calculation of simple means and percentages from the data pro- 
vided in the DOD and trade/ technical school"' |uestlMnaires indicated that 
training management, conduct, and other practices in the courses studied 

i ,*- ' r 

are as follows: . - # ^ 



1. .Trade/ taehnieal sahoels (T/TS) and DOD ichobls ^reportad data differing 
along ^s#Ye^^sl di^ansl^onsJ ' , 



POD T/TS 



Counm J^angth (wliWks) , ^ N 

Coursa Langth (hours) ' * 

Student Class B±mm ^ 

^nual Student Output 

Number of Inst rue tor a 

Number of Administrators /Superviiors 



13 


. 38 


462 


1059 


26 


21 


877 


78 


30 


8 


3.5 


2.2 



2. Calculationa based uppn the data for equivalent .course titles yielded 
siMlar student/inetructo^ ratios. The DOD ratio is 10,3tl and the 
corresponding T/TS ratio is 15*7p1. * 

Conduct ^ 

3. DOD schools reported devoting approximately 12% of the instructional ' 
time to lectures; T/TS reported devoting approximately 27% to lectures* 

4. In evaluation of courses, instructors, and students, T/TS indicated 

a leaning toward subjective opinions, written observations, and Instructor 
judgements; DOD schools ^reported leaning toward^^omal reviews, check lists 
*and the results of performance and written tests, 

5* Differing attrition rates were reported, D^ courses' experience 9%; 
T/TS courses experience 18% * 



4 

9 



6* Llttlt useabla InforMtioii "^^as ^vld#d by either group of respondents > 
tharafora a eoaparatlva cost analysis not carried out, ^ 



CONCLUSIONS 

Considarlng the limits lapostd upon our data by tha small number of 
useable questionnaires, we believe the available evidence supports the 
following tenatlve ooncluslons, 

1/ Job training, as conducted In DOD schools, is more job-perf ormanoe 
oriented; evaluation is more objective. 

2. Student/instructor ratios are similar, 

3. Considering that the DOD courses studied employ approximately four 
times as many Instructors to graduate 11 times as many students as do T/TS 
courses, DOD productivity eKceeds that of trade and technical schobls. 
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INTRODUCTION 

. * ■ ' . . ■■ ' ■ , ■ " . . 

OBJECTIVE . , . . • 

This Study was undertakpn ibt 0ASD(M4RA) to gathar comparative data 
on currant practica in tha managamants conduct^ and casts of initial skill 
training (job f training) across several of the major Institutions which pro^ 
vide such training - 000, businiis and industry, and prlvata trade/ 
technical fchools* The gathering of such data was undertaken to provide 
OASO(H^KA) with information for comparing its own job training management 
procedures^ instructional practices, and training output/cost ratios with 
those of counterpart civilian training pr^r^s* 

♦ 

BACKGROUND 

With personnel costs increasing and now exceeding 50% of the military 
budget, there is keen interest in improving th^ cost^ef fectivaness of all 
facets of military manpower acquisition, training, utilisation, and reten-- 
tion (1, 2, 4)* Formal military individual training and education for 
officers and enlisted personnel presently requires an annual expenditure 
in excess of six billion dollars* In manpower terms these activities 
Invdlve about one^sixth of all military personnel as students, instructors, 
and support personnel (2). An important component of this individual 
training is enlisted initial-skill training. This is- the training given 
after recruit training, to provide enlisted personnel with the initial skill 
and knowledge required for entrance into a specific military job* In FY 77, 
546,000 service personnel are projected to undergo such training in over 
600 courses (5) , 

Such a significant block of activity and finanelal conmiltment raises 
concern about the cost=ef f iclency of such operations (4), Since many of 
DOD's initial-skill training eourses have civilian Tcounterparts , compara"' 
tlve observations between the two are rwtural* 



Tha civilian stctor Migloys aany dlfferMt kinds of traj^ing and 
educational sattings which pursua a variety of objeeti^€s. ^ase inciud© 
colleges p public vocational education, business and industTial training 
schools^ and .technical and trade school^. The drawing of simple macro 
compariaons across job training institutions is a difficult undertaking. 
However* such comparisons have been made. Soma have looked at cost- 
efficiency outcomes between college programs and military initial-skill 
training schools for the"^ purpose of ascertaining student/instructor 
ratios (3), Others 'have looked at public vocational education courses 
and military job training for the purpose of assessing the feasibility '^f 
contracting with civilian training institutions 4or equival^t military 
job training (4), 

Unfortunately 5 such comparisons have contributed to a confusing plc^ 
ture* College courses* wl^ch are mainly . lecture * and not job-oriented, - 
, cannot be considered equivalent to military inltlal--skill trairting courses 
.which are niainly non-^lecture and have different objectives. Comparison of 
student /instructor ratios between these courses has been misleading. In 
a similar fashion j comparisons qf costs in public vocational tr^ning 
classes, which stre frequently aftar^hours ajad use extant facilities^ with 
military initial-skill training classes , which operate in a much different 
setting, have led to misleading conclusions (3) - 

It would appear that the validity of comparative analyses of military 
job training and civilian job training would be enhanced if the compared 
courses and training situatJ.ons^ were reasonably similar. Business and 
industrial training courses^^d proprietary trade and technical school 
courses are specific and job related, and appear to have more in common 
with military initial-skill training courses than either college or public 
vocational Gducation classes, ^ * 



ERIC 



The impprtance of job training to the effectiveness of the arrned 
forces cannot be questioned. To aid DOD in achieving efficiency in the 
conduct of its ^.nltial-skiir trailing, it is important that it have at ' 
its disposal accurate and valid data which reflect legitimate comparative 
analysis between military training and equivalent civilian training * 
situations. ' ' ^ ^ 

RATIONALE * • ' ' /'^ 

T^is study was undertaken to develop a inore in-depth cameo analysis 
of specific parallel training practices in non-military programs for 
comparison with aquivalent DOD practices - to probe beneath the gross 
statistical comparisons that are typically made. 



It has been reported that extensive e^j^valent job training is being 
conducted in the private sector by commercial companies in business and 
industry and by proprietary trade/technical schools (6). It was these 
private training resources that 0ASD(M6fRA) chose to compar^e with DOD 
training schools. 

Therefore J a comparative analysis of training practice between 
private sector and DOD schools was carried out. This analysis was deslgne 
to look at ini L ial--skill training to det^^mlne how it is managed and con- 
diicted and what it costs, ^ 
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METHOD 



APPROACH , 

Training courses for 12 high-dansity jobs known to have military/ 
civilian countetparta were selected for study,> The 12 were eeleetad 
to represent a, range, of skill complexity, instructional time, and resource 
requirements. Each one led to a sub^professional, non--degree-requiring 4 
job for' which only vocational/jtechnical preparation is necessary^ Each 
was taught in both the military and civilian sectors. Job equivalence was 
accomplished across the institutions to be queried by cross^-matching job 
descriptions as carried in Dictionary of Occupational Titles (DOT) codifes (7) 
and in military occupational codes. (16) ^ 

Table 1 lists the 12 courses selacted for study by their DOT job 
titles and codes. It was decided that a Mlled questionnaire would be 
the most efficient data gathering instrument, in light of the time and 
funding available Sor the study. Accordingly, a questionnaire was 
specially designed to obtain information on overall training management^ 
conduct and costs for each job training course* It was constructed to 
obtain detailed data in five different areas i 1) Description and Conduct 
of Course; 2) Development of Training; 3) Method of Course Evaluation; 
4) Evaluatio^ of Students; 5) Cost Allocations, A copy of the question- 
naire appears in the appendix. 

The original project design made provision for a follow-^up infervlew 
with selected respondents if it was found to be necessary ^ in order to 
check on the reliability of the questionnaire responses or to resolve 
problems. 

> -J 



TABLE ^ JOB COURSES SELECTED FOR STUDY 



DOT JOB Tf TLE ■ DOT NUMBER 

Aircraft Mechanic, Electrical & Radio |^5.381 

Airframe & Powerpl ant Mechanic 621.281 

Automobile Mechanic , 620.281 

Bulldozer Operator 850.883 

Civil Draftsman ^ 005.281 

Clerk-Typist 209.388 

Dental Assistant - * 079.378 

Digital Computer Operator 213.382 

Industrial Truck/Forkl if t Operator 922.883 
Medical Lab Assistant 078.381 

Stock Control Clerk 223.387 

X-Ray Clerk 079.368 
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ORGANIZATIONS QUERIED 

The respondents for the study were selected from the three classes 
of institution; (1) coimercial civilian companies, industries, or service 
institutions, (2) proprietary trade and technical schools, and (3) military 
service schools. The latter group was sub-divided into Air Force, Armys 
Navy, and Marine schools. , ' 

^ A total of 134 questionnaires were sent to the job course training V 
directors or managers of the respective organizations ^ Questionnaires 
were sent to representatives of 33 trade and technical schools, 29 coraner- 
cial companiiis, and 20 DOD schools. 

4 

As a general rule, we attempted to elicit information about each 
training course frDin four commercial companies, four proprietary schools, 
and four DOD schools. Further, we attempted .,to reduce the workload on 
each of the respondents by. asking them for information on no^ more than 
two of their courses. Some departures from this planned "four by two" 
mpdel were required, because some organizations taught only one course, 
some courses we^e taught at only one or two DOD school sites, or, as in 
the case of the Navy, Memphis proved to be the site of administrative 
control for almost all of the courses. i 



Follow-up telephone calls were made to each addressee to insure 
recjeipt of the questionnaire by the appropriate official, to resolve 
problems, and to encourage their timely execution and return of the 
questionnaire, fL... % 



J 
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DATA REQUESTED.. ' ' ■. , . . ' 



Tharp ^wllfa three types of information sought In the /questionnaires 
management, .conduct of* instruction, ^nd cost data. In the management ^ea 
we were attempting to ascertain the nature *of the managemenb'-^ructure and * 
the course demographics, with respect to training, i^o are the dacision 
makers; where are thay |.n the administrative/panageaftit structure of the 
organization? How big is the Instructionar staff? What data are used in 
course management decisions? How' is the course updated and revised? 

^ The second type data involved aonduGt^^^^?wtruatian* . The ultimate 
cost and ef f ecciveness of training can be affeGted to a large extent by the 
method of instruction which is employed. Computer assisted methods may have 
a very high front and costs but in the long run they 'may train more students 
to a higher level of proficiency^ Simulation methods may considerably*re=^ 
duca the overall cost of training. These and similar considerations can . 
affect the student-instructor ratio, student proficiency, and overall in^ 
structional cost. We- sought information on how the course content was 
developed, on training methods employed, arid on how evaluation was con" 
ducted* 

Jit 

The third area was aost a7taaatian8 . Thete are nMmerous strategies 
for breaking out costs. Each one highlights certain aspects and tends to 
obscure others. Costs may be overt - such as the cost of equipment, text 
books, and instructors' salaries. Or, they may be covert - such as the 
costs of facilities and administration, or the costs incurred by keeping 

a student out of productive employment in order to train/retrain him, 

f 

Our cost data questions were geared to provide us with basic cost/student 
outpd't Information* 
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DATA RECEIVED . ■ , ; . 

A total %f 63% of the questionnaires wer^ returned within the tiiAe 
whlch/was available for the stu^y, Of these, 2'5 were from military ' ' _ 
, l^^vice schools j 32 were f rom 'busin,^ss and industry and 24 were from t^dmi 

tachn^csi schools • There were "'four refusals to cSpper^e and on one ' 

* - ■ ■■ , ' * 

occasion, the questionnaire apparently was not delivered. The rpturns 

/ . ^ ' - ^ ' > ^ ' " . " 

from business and industry were striking in ^their paucity of dati. 

WitH^t B^aeptiorij business and industry representatives informed us that 

they either did not train personnel for these particular jobs anyimorep qr 

\ 

that if such training was carried out somewhe^ within the £^ompany^', they 
were not sure where. , A number of these individuals \^o phoned to explain 
their negative responses , informed us that their compaa^^ now hire people 
ready-trained In these jobs. Their main source is trao^rfechnical schools. 

^ Table 2 is a response Tnatrix showing the questionna^^ ^CTo^n pattern 

by course title and by institution. Each cell in the matrix represents 

one training course to which a q^astionnaire was sent. 

r 

Gfc the 41 respondents who reported useable information ^ 23 of these 
did not report useable cost ^ata. Various reasons were given: many kep'fr no 

cost figures at all, some had coqj figures categorized differently from the 

- _ _ - . / ' 

questionnaire, and two DOD sources cited regulations prohibiting their dis- 

~ i ^ \ 

closing such infprmation. Other DOD and T/TS schools apparently preferred 

to respond with NA (not applicable) instead of revealing their cost figures 

The #fe3ponse" rate for this questionnaire was about as expected for 
such studies. Undoubtedly, ^the return^ rate could have been increased had , 
there been more time for the respondents to prepare their responses, and 
had ttiere been* time to follow up and conduct ^personal interviews with th^ 
individuals who were providing fncompl^te Information, The returned ques- 
tionnaires were received so close to the due date for the project report, 
that interview trips were not of practical value. Thjese conditions should 
be kept in mind when considering the data analysis and findings. 
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TOCK CONTROL CLERK . 


X 

A 






0 0 0 0 


0 






IRJ|AME MECHANIC 


X 




N 


XX 


0 




0\ 0 


















OMPUTIR. OPERATO| ,. 


X' X 


1 




^ X X N 


0 


0 


o; 


ENTAL ASSISTANT 


X 


X 


N 


• * ^ x' X 


0 


0 


0 0 


ABORATORY ASSISTANT 


X 


X' 


N 


'x 


0 


0 


R 0 


»RAY ASSISTANT ' ' 


JLi 


h 


N 


N 


0 


0 


0 R 



CODE: X ■ Questionnaire ^llled.out with useable data 

0 - Questionnaire returned because course not taught 

R = Refusal to cooperate 

Blank = Questionnaire not returned (reason qnknown) 

, N - Questionnafre not sent (no course available) 
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DATAiANALYSfS . 

f The^^tudy's original analysis plan Ccilla^X for an unfolding Analysis, 
Thig'^ wquM have piraceeda^^f rom the global to tWe' specif ic ; from the most 
c^i^p^ed presatitation ,(o? da^a to^a detailed v^iced-otit'' a^ong the %#veral 
dinjefisipns of the" qj^estionttaite ; .iti^itift^dn; by. institution^ arid oouMe 
by course. That ^l^n was /modif^d in view of the fact that the data re'= 
turned was mod^Wy with no technical infotro^fi-on at "all from commercial , 
f companies, and IJLttle useable cos€ data 'from anyone,. Since -thfe Ns war^ 
small and there were a large numberf of '^jrpty tells/in the data matrix ^ 
all DOD questionnaires weje pooled into one set, and all trade/technical 
questionnaires into a second set> ^The analysis was confined to the 
calculatien^f simple means and percentages. The results section presents 
simple coinparison& of management and courtee conduct praQtices between 
DO'D schools and ft ad^/ technical schools. 

The data are presented in two arrays. The first pr^pents mean 
^ores and percentages collapsed across all job courses for DOD schools 
and the trade/techiiical schools. Tha, second array presents a comparison 
between selected " sped fic matc^fed courses for the reporting DOD schools 
and the reporting trade/ technical ^hools , This second prray presents 

data for three courses: Auto Mechanics Computer Operator and Avionics 

/ 

Mechanic, There were 10 specific points of comparison, These were N 

I, 

grouped under one of four major headings;, co^urse demographids » trainiTijg 
method^ p staffing^ evaluation. 
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RESUlfTS & DISCfJSSWN 



MANAGEMEI^T ? ' • ' ^' 



Course operation, staffing, and content decision maMng areas are in- 
- - ^ ' \ 

eluded under the management hea^lhg: There 'are .15 questions which relate 

^ to these three areas* ^^Catile 3 presents the results for bbth DOD schools 
^and for trade/technical schooliTx 

■■^ _ /'^ 

Items one through ten deal with course operation or demolraphics , 
Ins|iection of the responses for thesfe items reveals fiome salient points* 

^ The firat is tliat trade/technical schools* courses are muc-h longer in 
terms of calendar time, Howpver, simple division shows that students in --^ 
the military schools spend 27% longer in class per week than do those in 
trade/ technical schools. The military schools convene class 35,5 hours ' 
per. week whereas the trade/technical schools convene class for- 28 hours 
^^per week. The number of hours per|course is twice as large in the* trade/ 
technical s4h09ls as ihpthe militat^y schools. Evaluation of this is 
difficult. Longer or shorter class time can only be evaluated in light 
of student proficiency levels (training effectiveness). The assessment 
of graduating student proficiency between two or more similar courses 
poses a complicated technical evaluation problem. The scope of such an 
tndertaklng exceeded the limits of this study. Therefore, information 
on comparative course effectiveness will have tb await further study. 

A second point Is that the military schools maintain a much moVe 
massive trailing program than the trade/technical schools. 'The average 
annual student input is almost 11 times greater for the military course^. 
In that same vein, military schools begin six times as many classes pe^ 
course pter year J In addition, the average military class size is 24% 
larger. 
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We note tfiat the trad^^^^f^C^al^^ ^hooit have been teaching their 
courses 50% longer than the mii^aryi^f chools. The amount of time de- 
voted to OJT is small for , both ^DOD and T/TS* Trade and technical schools"' 
tended to do more-OJT th4n did D5fi schools* 
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TABLE 3. MANAGEMENT DATA 

/ 



COURSE OPERATION 

1. 

2. 
3. 
4. 
5. 
6. 
7. 



8. 
9. 



10. 



'se length in weeks (iverage) 
Total number of academic class hours (average) 
Average annual student Input 
Average annua.1 student output 
Number of classes starting in this cqurse/year 
Average starting class size 
Range of starting class size: Largi 

DQg T/TS 

, ' 40 32 

Number of years this course has .been taught 
Students training full time: YES 



7 

Larofest 



to Smallest 



NO 



DPI T/TS 



If course 1s partly QJT, perce 
tTme devoted to ffiJT 



100 

of 



96 



POD 
0 



T/TS 



COURSE PERSONNEL 



\ 



n 



12. 



13. 



14, 



Average number of actual primary instructors 
assigned per year 

Average number of assistant instructors (peer 
tutors i coaches s ^ teacher's aides ^ etc.) 
assigned per year ^ ' 
Average number of the following 
"Overseeing this course per year 



Average number of support people 
per year (maint. , med 



Program AdmiiH^stfators 1.1 
Supervisors/ 
Managers 

servicing this course 



CONTENT DECISION 



housing, clerical) 



15. Major decision maker on course 



revision/content: 
Administrator 
Supervisor 
Primary Instructor 
Committee 
Outside Expert 
Other 



nnn 


T/T^ 


33 


38 


462 


1059 






877 


78 


45 




26 


21 


12 


.18 


1% 


• 

8% 


27/ 


7 


3.1 


1.1 


•5 1 1 


1 1 


2 4 


1 4 i 


1 5 


4 






43% 


65% 


35% 


24% 


4% 


35% 


43% 


18% 


0% 


6% 


35% 


29% 
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Items 11 and 12 deal with the nuaber and allocation of actual 
InAructors and other, t^iiahing personnal, fhe finding here is that 
military courHes ^employ -nearly four times a^ many instructional st^f 
as do the trade/technical school cpurses, . # . . 

Items 13 and 14 present the number and distribution of ,non teaching 
personnel who a^a involved with the course* It can be seen that the mil^>.^ 
Itary courses generally have twice as many administrative and support 
people* \ 

V, 



Item 15 presents some interesting data which deaf with the level it 
which course content decisions are made. The military schools show a 
rather even decision making process distributed among administrators, 
supervisors* and some type of -committee, with practically no involvement| j 
of the primary instructor. On the other h$nd, the trade/technical schools 
invest the majority of— their decision making in the administrator. The 
rather broad based decision making process used by the military schools 
may be due in part to the sheer size of the teaching operation itself 

\ ' 

The most important information to be gain^ from this section of the 
questionnaire cdmes from the results of two different eomputatlons. The 
first is the student /instructor ratio. This has become a popular referent 
considered by many to reflect efficiency. Because of the popularity of 
this particular ratio, we elected to obtain our data from direct telephone 
interview, since the questionnaire responses could be interpreted in several 
ways* 

Many tmde/technlcal schools reported that one instructor was assigned 
per class, regardless of the type of instructional activity* That is, 
lecture, demonstration, and hands-on training all utilized the same student/ 
instructor ratio* 



2^ 
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The military siCuation. is somewhat more compleK*^ Previous reports 
have put the ratio at anywhere frum lil up to 5il (3, 5). However^ unlike 
the trade/ technical schools,^ the ratio varies widely in the, military set- 
ting depending upon the particular phase of instruction. Based upon our 
telephone interviews, we found that for lecture classes, the ratio could 
be as high^as 24-1. In demonstration it was about 10:1, and for hands-on 
training it was 5:1 or less. Many courses spent time in each of the three 
activities. .Therefore, we calculated a weighted mean average student/ 
instructor ratio for those courses in order to arrive at a course average,^ 
Table 4 presents ratios by equivalent course title for both military and 
trade/techtiical schools. Sinco' the student/instructor ratio varies 
widely between c6utse titles we restricted our comparison along two dl- " 
mensions. First, only courses of equivalent course t^tle would be used 
in a comparison. Second, only data which could be confirmed by telephone 
interview would be included. As a result we had seven course title 
comparisons which could be made. These are the ones presented in Table 4. 

TABLE 4. STUDENT/INSTRUCTOR RATIO BY COURSE 
- FOR MILITARY AND TRADE/TECHNICAL 
SCHOOLS 





POD 


T/TS 


Clerk Typist 


^16:1 


15:1 


Auto Mechanic 


10.6-1 


19.4-1 


Avionics 


8.6:1 


20:1 


Air Frame 


6.7:1 


20:1 


Draftsman 


7:1 


12:1 


Computer Operator 


8.5:1 


6:1 


Laboratory Technician 


15:1 


17.5:1 



It may well be that the nonf lexibility of the trade/technical schools 
in adaptirtf^ the student/instructor ratio to the teaching situation could 
be contributing to the fact that the trade/techn.icar schools 'take so much 
longer to complete a course. If that were fhe case, then the smaller 
ritio would be ihferpreted as an instructional^ advantage rather than as a 
liability. Obviously s there is much opportunity for confounding of data 
and multiple conclusions with this ^tio* 

The data from Table 4 were averaged* The average studenL/ Instfructor 

I 

ratio for the military schools was 10.3:1 and for the trade/ technical 
schools \tes 15*7:1, This situation is pdrtrayed in Figure 1. 
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^Figure 1. Mean Student/Instructor Ratio 
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V% chlftk that an aitetnate computation la mor# approprli^ta to the 
cireuutuctts and mora ra|svant to tha Issua of Instructional productivity. 

This altarnate computational finding follows from the first. In Table 



3 it was seen that for the military almost four tlAas as many Instructors 
turned out 11 t^aa as many studanta. niusi^ aach Instructor In the 
military rapraarated an output of approMlmataly 29 students , while his 
trada/ technical school counterpart rapresentad au output of appraKlmately 
10 students* It can be arguad that the military makes 2.9 tines more 
productive use of extant ^^^tt than do the trade/technical schools* This 
situation is graphically prnsanted in Figure 2^ \ 
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Figure 2. Mean Annual Graduates/Instructor 
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The ttanagCTent data ean be distilled Int© two ba&le functional find* 
ings: Ona Is ths studant /instructor ratio p and tha other Is tha Instruetor/ 
MfflioU. Atudant^ q£ thase rmtlos ba eonaldavad to ba 

an index of Instructional productivity with tha second ratio providing a 
iBore stable measure of utilisation of staff resources. 

The tradaoff for a responsive and fleKible student/instructor rati© 
is an overall course ratio which Is lower than that resulting from rion'- 
flexible instruction. The sheer sl^e of the military operation demands 
a larger staff and more genera^ administrative spread of raaponslbility. 
However^ the dramatic difference found In the utilisation of extant staff 
resources (Figure 2) points up the fact that the DOD's instructlohal 
productivity at this level certainly tends to neutrallEe whatever dis- 
advantages are ascribed to the loweifctudent /instructor ratio. 

/ 

CONDUCT OF INSTRUCTION 

This section includes training methods , development of training, and 
evaluation of training and students. Under development of training, we 
were attempting to get a picture of siaff utilisation in the development 
of each course. Table 5 presents some of the responses to this section * 
of the questionnaire. 

It appears from Table 5 that the trade/technical schools tend to in- 
volve the training staff to a greater extent in the deveiopment of the 

course. The military schoQls tend to utilise some of the training staff 

% 

for job and task analysts and the development of instructional materials 
only. The trade/technical schools show a fairly even spread of staff 
involvement. This finding Is eonslstent with the lact that DOD school 
organization provides for course development by specially trained course 
developers and subject matter experts from the field, leaving course con^ 
duct to instructors. ^ 

23 



TABLE 5. DEVILOPMENT OF TRAININS 

PERCENT OF TRAINING STAFF ASSIGNED 
TO EACH DEVELOPMENTAL ACTIVITY POD T/TS 



Job & Task Analysis to Dtttnnlnt CQursi Conttnt 19 69 

Dtvtlopmtnt £ Pfoductlon of Instructional Mattrlals ' 25 69 

Devtlopintnt & Pfoductlon of Madia to Support 
Instruction 20 63 

Dtviloprant of Instrumants for Assessing 
Studtnt Ach1av»iant 16 66 

Devtlopmtnt of Quality Control Proctdures for 
Assessing Course Effectlytntss 16 60 



Table 6 presants tha questionnaire responses to the section on methods 
of training* Sevan 'Items addressed this issue* 

The first observation In Table 6 is that the trade/technical schools 
report spending 2,3 times mora time In lecture activities than do the 
military schools* In both cases however ^ lecture activities occupy less 
t^an one-third of tha total Instructional time. 

i 

Further examination of Table 6 shows that the trade/ technical schools 
rely more on simulation and mock-ups and lass on actual Job equipment than 
do the military schools. The r«ai*nder of these responses show the two 
organizations to be similar In that they review their courses frequently, 
using a variety of sources of Information. 
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TABLE 6. TRAi>(IN6 METHODS EMPLOYED 



% OF TIME 

DOD T/TS 



1 . INSTRUCTOR-MEDIATED METHODS 



Classroom Lectupes . 12 27 

Denonstratlons (Visual & Oral) 7 10 ' 

Discussions & Smlnars 4 5 

Hands-On Skill Practice ' 63 50 

• On Actual Job Equlpintnt & Mattrlats 60 37 

• On Simulators or Part-Task Trainers ^ 3 13 

2. NON- INSTRUCTOR MEDIATED METHODS 

Progranined Texts 8 1 

Audio-Visual Modules ' 3 / 6 

(Video tape recordings, tapes, films, slides) 

Mock-ups, Exhibits, Displays O.S 2 

3. OTHER ♦ 4* 0.2 

4. PURCHASED A PACKAGE COURSE 

Yes ^46 

No • ' 96 94 

5. LOCAL CIVILIAN TRADE/TECHNICAL ADVISORY GROUPS 
PARTICIPATED IN DEVELOPMENT OF COURSE 

Yes . 9 44 

No -91 56 

6. COURSE HAS BEEN REVISED 

Yes . '.\ 96 100 

No 4 0 

7. COURSE HAS BEEN REVISED ON THE (ms OF: 

Feedback from Users of Graduates 91 88 

Feedback from Graduates Themselves 86 94 

Technological Change in the Job 86 100 

Recoinmendations of Advisory Groups 76 69 

Standing Policy to Update Instruct' n Periodically 81 . 88 
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Thm Issue of laetura versus noniseturs activities has been a recuE^rent 
one In the lltarature (8, 9> 10 > 11, 15), It us been variously cltsd as 
s neea^ipp^ eoftponant of Job training, as tha^^ause of spurious student/ 
Instructor ratlof , and as the reason for hlMer instruetlonal oost||^ In the 
lallltary. Figure 3 portrays the proportions of non-lecture Instruetlon 
as reported In the present study* It Is apparent that both types of 
schools utilize extensive non*lecture Instruction « The mllltai^ schools ' 
report devoting a slightly larger waunt of time to such Instruction. 
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Figure 3. Mean Percent of Non-Lecture Time 
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EVALUATION ^ 

■ ■■ \ ■ \ 

Eight uaJOF questiotts were posed with respect to aetjhodt of course 
evaluation. Tha It ams probed Information about ©valuation of tha eourse 
aahlant and matarials, lnstruetors» and studants. Also, the Iggua of 
attrition was addressad in tha aighth quaation, Tha rasponsas to thasa 
ItaM ara prasantad in labia 7* 

Bath trada/ta^hnieal and Mlitary schools tand to usa a wide array 
Ibf avaluation mathods and data* Trade/ teGhnlcal sahools tend to utilize 
iubjactlva parsonal opinion, past eKperlance, and written observations 
TOra than ^ha military schpola* On the other hand* the military schools 
tand to rely more on formal ravlews^ rating acalas* check lists, and per- 
formance than do the trade/technical schools. The responses to Item 7 
indicate that student course grades In military schools appear to be based 
more on standardised and locally designed written and perfomance test 
resufts, whereas grades in trade/technical schools are based more upon 
Instructor Judgement and locally developed tests* 

The reaponaies to Item 8 (attrition) show two trends. First, military 
schools experience about half as much attrition as do the trade/technical^ 
schools* Second, more military students are removed for poor wock rather 
than electing to leave the course* On the other hand, similar numbers of 
trade/technical students elect to leave the course as are removed for 
poor work. This probably reflects the higher degree of personal- control 
exerted by tha military* 
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%^ABLE 7. COURSE EVALUATION 



% REPORTING 
POD T/TS 



T. nflow 3dt$ your tpi1 nJrig s tifF evilui tt tng mafepTiTs F 

Ptrsonal Judgtmaht 62 94 

FonMl rtylMf > ^ 83 94 

Subsequtnt Job pffrformanct ' 83 81 

Past exptrlerrce 58 75 

Institutional policy ^ .54 §6 

* . OthtP ' 33 0 

2.- In the evaluation mentioned above* what data | 

are used^ln making the decisions? ^ 

Checktlst - 58 25 

Student performance ratings 67 88 

Student test scores 54 81 

Written opinion 75 69 

Other 46 31 



X 3. Does your tng staff evaluate the course instructor? 
\ Yes 71 100 

No 29 0 



If so, by which of the following methods? 
Observation 
Student Rating 
Student performance 
Written test 
Seniority 
Other 



100 

53 
76 
0 
24 

(\ 24' 



100 
81 
81 
31 
13 
13 



In the evaluation mentioned previously , what data 
are used In making the decisions? 

Rating scale 

Test scores 

Written observations 

Supervisar report 

Other 



47 
35 
82 
71 
12 



31 
19 
94 
94 
31 



By which of the following methods does your staff 
evaluate course content? 

Personal judgement 
' Formal review 

Subsequent job perfonnance 

Past experience 

Institutional policy 

Other 
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54 

92 
79 
37 
37 
46 



81 
88 
75 
69 
38 
19 



TABLE 7. COURSE EVALUATION (Continued) 



I R EPORTI NG 



DOD 



In the tvaluitlon mtntlfned above » what data are 
used in iraking the decisions?' 
Checklist 

Student performance ratings 
Student test scores 

Uritten opinion - ^ ^ ; . 

Other 

What percentage of each of tne following Items Is 
used In detennlntng the student's course grade? 
Locally developed written examinations 
Standardised written examinations 
Locally developed per^fofmance tests^f Job skills 
StandardlMd ptrformanei tesAs of job skills ^ 
Instructor Judgements of student's proficiency 
Peer judgments &f student's proficiency 
Other 

What Is the overall average attrition rate in 
this training course? 

Of all th^students in the course^ what percent: 
Graduate 

Are removed for poor work 

Elect to leave themselves^ 

Must recycle (remedial work) for graduation 

Leave for medical reasons 

Leave for other raasons 



J 

50 25 

79 81 

67 75 

54 63 

54 31 



35 24 
2 5 

42 28 

19 12 

6 22 
0 0.3 
0 9: 
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89 82 
,6 5 
0.5 6 
3 ' 1 
2 

1 4 



COST ALLOCATIONS 



Cost of Iristruetlon is^m reeurrMt themm whleh has sngandartd mueh 
controv€«y (1, 2; 3, 5» 6, 12, 13. U). Though It was bayoni the scopa 
of ths pffBsnt study to eoopletely Investigate this issue in detail , we 
did hope fe determine and Qenpare the apptoKJaate easts ©£ the training 
l^rogrms under study. The cost section ineluded in the quest iorinaire ' 
provided eost categories which were fairly general and covered a broad 
range of budget allocation options , 

Our returns indicated that few schools keep cost data for even the 
broad categories called for in the questionnaire. In fact, it appeared 
as if no two schools kept east figures the same way. ThuSj it became 
impos|ible to calculate basic coat flgutes which were equivalent across 
schools. Time limitations precluded on-alte intervlewa with raspondents 
in order to solve this problem. Therefore , cost calcuiations were not 
included in this report. ^ IP 

SINGLE COURSE ANALYSIS ^ 

It la apparent from looking at the different types of job courses 
which were Included In the sample that a wide dlveralty of training situ- 
ations and cost factors exlats Iri the different training programa. This 
is mainly due to the rtature of the training taaks themselves. The outcome 
is that our reported data collapsed acroaa all job courses is reflective 
only of the general situation. In order to gain some perspective ^ we 
selected tfireejob courses for which we had comparable between-school data, 
and compared questionnaire responses between the military and trade/ 
technical schoole. 

9 
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Those analyses Involved the aute ^eehmmle (3 DOD^ 3 t/TS), computer 
operator (2 DOD, 2 T/TS) , aad avionics mechanic (2 DODp 2 f /TS) . The 
erfh^ses were co^ar^ on 10 specific pQlnts* These points were grouped 
under the following hudlngs; course d^ographlcSp training methods , staf- 
-^tag^p and eroliiatlan. The orgTOlEattoirTrf eiBapAr\|^(i points was as 
follows s 

Course Demographics 

1« Course Lragth 

2« Student Output 

3. Classes Per ^aar 

4« Class Size 

Training Methods 

5. . Lecture/Non-^Lecture 
Staff tog 

6. Instructors Assigned 

7. Support People * 
Evaluation , ' - 

8. -Course Evaluation 

9. Student Evaluation 

10 • Instructor Evaluation 

4? ...... 

The equivalency of the courses was ascertained by a cross referencing 
procedure. The Dictionary of Occupational Titles (7) from the Department 
of Labor was used to obtain the DOT ni^ber fbr each course title. Then^ 
using the DOT number and course description as the> identifier ^ each course 
title/ was cross referenced with the Military--Civilian Occupational Source 
Booif (17) for each of the service branches* In this way s$^lar course 
titles and descriptions were selacted on the basis of these published ref^ 
erence guides. 



31. 



AUTO MECHANIC . ' . 

The muto ttachaala dasl^atlon was DOT No 620.281 and the IISOE cluster 
was "tranaportatloQ*', The conposlte service Job statttent was^ 



^ Ingpt B ettp wtetateai «g# g€pat eoDbtirtlon mgtee 

powar vaMalaa. ^ulysaa lulftrnQtlons by visual and/or auditory 
axaslnatloQp operation » and usa of appropriate test equlpnent, 
RafliovaSy raplaaasp repairs, and overhausl vahlale syat^is mch as 
Mchaniealp alectrleal, air eondltlonlngp fuel-air » antl-ponutlon, 
and aalaslon eontrol systmSp poller train p brakes , steering, and 
suspension syatams. Perfoi^ pnventlva and special nalntanance. 

(17) 



We had data from three DOD and three T/TS courses this eomparlson. 
The data were stnmned and averaged for both the DOD an^^T/TS courses, such 
that we had two sets of average questionnaire responses » one for the DOD 
and one for the T/TS courses » These two aats of averaged questioimalra 
responses were than used In the point^by^polnt comparison. 



\ Course Demographics * The general description of the course was 
pointed out in tYm data by the following items i 







POP 


T/TS 


1. 


Course Leng'th (weeks) 


13 


39 




Course Length (hours) 


361 


1137 


2. 


Student Output Per Year 


■ 1415 


170 


3. 


Ho, of Classes Far Year 


71 


10 


4. 


Class Size 


17 


28 



The course length for auto mechanic was quite similar to Ae overall 
response on the questionnaire for the 12 courses* ^ dl^vision of hours by 
weeks shows that for the auto mechanic, the DOD spent 28 hours per week in 
t iss and the T/TS spent 29 hours. This does differ from the genet'al re= 
sput*ae. in tha^ overall, the DOD typically spent more hours per week in 
clas.' than did the T/TS courses. 
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The figures on student output and number clasies per year indicate 
that the DOD maintains a nueh larger training operation than doeo the T/TS* 
This is not un^peeted. From the last itrai it can be eeen that the T/TS 
class size is l«l^r than the DOD; Thia situation is just reversed from 
the general findings presented In the report. Not only is the direetion of 
the difference reversed^ but the magnitude of the difference is gi^ater* 

Training Methods . Six different types of training methods were 
compared In the auto mechanic course. They were as follows i 



DOD_ T/iB 



5. Percent course instructional time spent in: 

Lecture 15 21 

Demonstration t3 11 

Simulation ' , 0 28 

Job Equipment 59 38 

Mock-Ups 3 8 

s OJT 0 0 ■' i 

V. ' ' ■ ■ 

T^e T/TS course utilized more claSs time for lecture than did DpD* 
this outcdme may explain part of .the course length differential discussed 
above, but it is speculation. The DOD appeared .to invest course tiif r 
In 'demonstration and actual job equipmfent whereas T/TS spent its course 
time in lecti|rej iob equipment^ and almulafiion. An interesting contrast 
is that DOD spent- no time in simulation whereas T/TS, spent its second 
largest time block there. Finally, neither DOD nor T/TS utilized mock-ups 
or OJT to any large extent. 




^ Staff Ins . Two Mj^r qutstloAs wmn mBkmd In thla ssctlorii wt^iy' 

gi • ibOD V f /TS 



6. Nop of prlmai7 md asslstut instructors . 
msBignmA to the course 70\ - '13 

Student /Ins true tor ratio : ^ llii " 11:1 

No, of gra^iates per Instructor 20 - 13 

7. No# of support people per ^ooursei ■ . 

Adnlnlst ration & Supervision ^ 10 3' 

*^ Support ^ 8 3 



The large nu^er of Instructors assigned to the course for DOD relative 
to T/TS Tefltets the overall size of the training operation which Is carried 
by DOD* The student/Instructor ratio for the DOD li similar to that report^* 
for the general data In the report. However, the t/TS rati© is much higher 
for the auto TCchanlc than the corresponding DOD inde% or the general report 
finding for l^TB courses. 

* This may well be due to the fact that in #5 abote, T/TS spettd* teore 
tine In lecture and aimulatlon than does DOD. The gipa^uates per (.ristructor 
difference reflects a DOD advantage which is similar/ to the one reported in 



the general data. With respect to "boch administratis ||ind support personnel 
DOD reports about three tinea as nfcny persons as does TfffS, 




li^i^tiasi . There ware three Items ^4er the evaluation heading « 



DOD 



T/TS 



8. IBfib H Iffii iM with respeet 

■ko edurse revision i (pWr^^tage narking each 
^ . • Itett).' ■. ^\ % : . ^ ^ ' [ ' :. 

A4vdnistrator 

Supervisor 

Instruatar . . - ; ^ 



Student Evaluation: 

. DOD used local at^d standardised written and 
V performance teats. 



^/TS used the same as DOD In addition to more 
personal judgement and past eKperlence 



33 
67 
0 



100 
67 
67 



10* Pertentsge Course^Attrition i ' 
/Poor work ' 

Elected to leave 
. Ui^known reason 
Other categbrles 



4 

1 
0 
2 
1 



38 
11 

s 

16 
4 



In the DOD the supervisor appeared tp play the gceatest role In 
decisions about the course and course revision. The administrator partlclp 
ted; iofflewhat and the Instructor did not have much effect on the decision. . 
in, the T/TS the administrator was the major'^eclslon maker with both the 
aupervisor and the Instructor participating ac similar levels. DOD tended 
to do- S roore formalized review thin T/TS. On the other hand, T/TS relied 
more heavily on past experienpe and personal judgement. 



\ 

The topic of attrition shows some interesting divergencies frotn the 
^general data. First, the DOD attrition was lowe| for the auto mechanic 
than the DOD genferal data Indicated. Second, the attrition for the T/TS 
was almost double the figure reported in the general data and nearly ten 
times greater than the corresponding figure for DOD. 

In sumaryp DOD courses appeared to have shorter classes with fewer 
students per class, more job equipment and demonstration class activities , 
a smaller atudenp/instructor ration, more aupport people per course, and 
more graduates per instructor. DOD's course evaluation tended to rest with 
the supervisor. Student .evaluation was based upon written and performance 
teats* Attrition was not high, and showed no particular causal indicator* 

The T/TS courses appeared to have much longer training tim^ with lar- 
ger classes composed of job equipment training, simulation, and lecture. 
There were few reported support persons per class and a large student/ 
instructor r^tio, with a relatively low number of graduates per instructor. 
Administration inade the major cdn-ribution to course decisions, with super- 
visors and instructors both participating an equal amount. Student evalua- 
tion was based upon performance and written tests, in addition to the per-- 
sonal judge-nent of the instructpr and past experiance. Attrition was 
fairly high, with the largest single categories being poor work and un- 
ipecified reasons. 
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COMPUTER OPERATOR " 

The computer operator designation was DOT No. 213.382 and the USOE 
cluster was "Business and Office'V The compeaite service job statement ^as 
as follows' ^ 

Perfora any one or a combination of the following s 
Operates md controls electronic digital computer to process 
business, scientific, engineering or other data according to 
operating instructions* Sets control switches on computer and 
peripheral equipment such as external memory, data comnunicat^ 
ingj synchronizing, input and output recording or display de- 
vices^ to Integrate or operate equipment according to progran, 
routihes, subroutines, and data requirements specified in written 
operating instructions. Selects and loads input and output units 
with materials such as tapes or punch cards, and printed forms 
for operating runs. Confers with technical personnel such as 
systems analysts, data systems engineers, and progranmers con^ 
cerning machine capability and operations. Types alternate co©'- 
mands into computer console according to predetermined instructions 
to correct error or failure and resmne operations. Notifies super- 
visor of error or equipment stoppage. (17) 

Our data came from two DOD courses and two T/TS courses. The data were 
average for both DOD and T/TS in a manner similar to that described for the 
auto mechanic. 



, Course Demographics . The five data items for this SQ.ction obtained 
<he f ollowing results I 





DOD 


T/Xfe 


1* Course Length (weaks) 


6 


2J 


Course Length (hours) 


235 ' 


525 


2. Student Output Per Year 


232 


53 


3. No. of Classes Per Year 


25 


9 


4. Class Size 


' 10 


3 
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Course length follows the overall pattern found in this 'study wherein the 
DOD c^rse was considerably shorter in weeks and hours of instruction than 
the T/TS course* The number of hours per week for the DOD was 39 and for 
the T/TS was 25, Thus, the amount of class time per week^was quite a 
bit less for the T/TS course. Figures for student output and nutober of 
classes per ye^r again reveat the larger DOD training operation. The last 
item, class bIzb^ shows a reversal. The DOD class has three times as many 
students per class as does the T/TS class. The general data show a slight 
tendency for DOD classes to be larger than T/TS classes , but not to the 
extent reported here* 

Training Methods . The training methods questionnaire responses fell 
into one , of seven categories for the computer operator. 

POP T/TS 

3. Percent course irrttructional time spent in- 

Lecture 8 15 

Demonstration y 11 6 

Simulation ' >^ 0 2 

Discussion 11 7 

Job Equipment 48 40 

Mock-Ups 0 3' 

OJT 20 0 

With Che exceptipn of OJT the ralationship of the data for POP and T/TS 
is the same as it was for auto mechanic. Both courses rely heavily on job 
equipmefit. The POD course tends toward demonstration while T/TS is more 
heavily weighted toward ^ecture* Both courses showed some time devoted to 
discussion for this o^ourse. The DOD course utilized demonstration and OJT 
slightly more than did T/TS and that is a slight change from the general' data. 
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. Staffing > There were two major items in this section. 



POD T/TS 

6, No* of primary and assistant instructors 

assignad to the course " 13 6 

Studant /Instructor ratio a 9^1 6: 

No. of graduates per instructor y 18 9 

7* No, of support people per courses 

' Administration & Supervision 4 3 

Support / 15 3 



The number of instructors per course was much larger for the DOD as 
would be expected considering the overall size of the training operation. 
However, the student /instructor ratio is also larger for the DOD as is the 
number of graduates per instructor. These two findings together suggest a 
better student /instructor ratio in addition to greater productivity 
(no* of graduates per instructor) for the DOD than for T/TS* The general 
data and also the auto mechanic data showed a slight advantage in 
student /instructor ratio f or ,the T/TS* However ^ in this course the 
situation appears to be reversed* 

These data also show a larger figure for both administration-super== 
vision and also for support persons for the DOD course than for the T/TS 
course* This pattern has been consietent within the general data and for 
the auto mechanic course also, ^ 
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Eyaluatlon . The last thr^e Items were' in the area of evaluation, 

POD T/TS 

8. Who is the major deQision maker with 
respect to course revision* 
(percentage marking each Item) 

Adminigtratdr 0 50 

,^ ----- _ _ 

Supervisor 0 0 

Instructor 0' 0 

CoB^ttee ' 50 0 

Other 50 50 

9. Student Evaluation: 

DOD used local and Btandardized written and perform^ 
ance tests » also feedback from employers. / 

T/TS used local written and performance tests, 
personal Judgement^ and user feedback, 

10. Percentage Course Attritions 5 ^ te,^^ 

fs Poor Work 4 4 

Elected to Leave 0 5 

Other , 19 

There was a noticeable change in the pattern of major decision maker for i 
both DOD and T/TS courses. The typical patterns that were seen for the ♦ 
general data and for the auto mechanic are not seen in these data* Tpe 
only similarity'^is the heavy participation of the administrator for T/TS. 
Otherwise, it appears that course revision decisions are made outside of 
the usual group of persons who participate in such decision in other ^ 
courses. o 

Student evaluation continued to show the same pattern as wai seen in 
the auto mechanic course and in the general data. Generally, the^DOD is ^ 
characterized by^ more formaliEed type of evaluation and the T/TS is char-' 
acteriEed by an additional evaluation componBnt which uses personal' judge- 
ment. In the case of computer operator » both DOD and T/TS reported a more 
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pronounced teu^hncy to use feedback from users of graduates than for other 
courses. Attr^t^ was greatest Che T/TS, with a majority dropping out 

for a variety of unspecified reasons, j The amount of attrition was the same 
as that reported for the general data./ DOD attrition was somewhat less than 
the general data and much less than tha^t for T/TS in thi^teourse* 

In sunnnary, this course for the DO^ was characterized by shorter trains 
ing tme, more students, more classes ^ ^nd larger class size. Hea%o^ emphasis 
was placed on utilization of Job equipt^nt and some OJT. The DOD had a larger 
student /instructor ratio and more graduafeBS per instructpr, DOD had a greater 
loading of support staff. Course evaluation tended to be outside of the 
teaching-supervision-administration group* Student evaluation was similar to 
other courses, with the added emphasis on feedback from employers * 

For the T/TS, the training was longer; although fewer hours per week 
were spent in class, there were fewer graduates and fewer classes with 
smaller class sizes. The greatest instruc tional emphasis was in working 
with job equipment and In lecture. The T/TS had a smaller student/instructor 
ratio and fewer graduates per instructor. Evaluation of the course was 
vested in the administrator and in other unspecified sources. Student eval-- 
uatlon was similar to pther courses, with the addition of feedback from 
employers- Finally, the attrition was similar to that reported for other 
courses and alsOj much larger than that for DOD. 

AVIONICS MECHANIC 

This course had DOT No. 825.281 and USOE cluster "Transportation". 
The composite service job statement was as follows* 

Installs, inspects, troubleshoots , repairs, overhauls, 
and modifies aircraft electrical and electronic control sys- 
tems, components, and associated electrical test equipinent. 
Inspects voltage regulators, frequency and load controllers, 
control pb^ls, anti-skid, nosewheel steering and starters. 
Replaces deractive parts. Services and repairs batteries* 
Adjusts electrical devices such as voltage regulators and 
limit switches. Fabricates wiring assemblies. Disassembles 
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components such as starters , generators j and retracting motors* 
Cohducts tests, using electrical and electronic test equipment 
^uch as voltmeter and oh.=^eter to isolate malfunctions* Adjusts, 
' aligns, and calibrates aircraft electrical systems using blue- 
prints and technical publications. Checks installed and repaired 
electrical and electronic components to insure compliance with 
technical specifications . (17) 



The data yare from two courses in DOD and two in T/TS. Th|i analysis was 
carried out in a manner similar to that for the other two qingle course 
analysis * 

Course Demo graj^hlc 3 . The results for these four items were as fol= 

lows I 







DOD 


T/TS 




1* Course Length (weeks) 




18 






Course Length (hours) 




658 


1535 




2^, Student Output Per Year 








A 




398 


/■ 40 




3. No. of Glasses Per Year 




39 


» . 2, ■ 




4* Class Size 




14 






again, course length for T/TS 


is 


much greater 


tha^for DOD. 


Hours per 


for DOD is 41 and for T/TS is 


29 


Student output End number 


of classes 



per year reflect the larger scale of the DOD opera t ion* Class size is a 
little larger in T/TS, but the difference '^ja^hly is-flPtf meaningful* 



Training Methods * The information on triinCng is as follows; 

POP T/TS 

5. Percent Course Instructional Time 
Spent in^ 

Lecture 6 45 

Demonstration 2 2 

^Simulation 4 2D 

! Job Equipment 46 21 

Mock-^Ups 0 5 

OJT 0 0 ■ 

Programmed Texts 24 ,'0 
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In view of the general data and previous single course analyses, the 
overall nature of these are not dramatically different* There are two ih- 
teresting points. First, considering the course title, the* amount of time 
spent in lecture for T/TS appears higher than expected. Second, the appear- 
^ce of progranmied texts as a major instructional component for DOD is new 
■v^in tems of previous analyses* The remainder of GOurae time was scattered 
through a variety of methods at low incidence levels. As in previous com- 
parisons, the T/TS utilizes lecture and simulation to a greater extent than 
does DOD. 

Staffing . There were two major items in this section, 

POD T/TS 

6. No. of primary and assistant instructors 

assigned to the course 33 4 

Student/Instructor Ratio 7il ZOil 

No, of Graduates per Instructor 12 , 10 

7p No. of Support People Per, Cou^e: 

Administration and Supervision 3 2 

Support Unknown 4 

The number of instructprp assigned shows the same type of differential be^ 
twteen DOD and T/TS as seen in all other analyses in this report. 

The student /instructor rtft^ shows a larger advantage for T/TS than is seen 
In ^tWe general d^ta or In the previous single course analyses. Support 
people data is%iirit©nciu§i^^:^^^ because of a lack of data on this topic from 
the military. 
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Evaluation. The final three items were as follows i 



WD T/TS 

8, Who was the major deelsion maker wlfch respect 
to course reviaioni (percentage Mrklng each 
Item) 

L 

Administrator 0 50 

Supervisor 0 0 

Inatructor 0 0 

Committee 50 0 

Other * 50 50 

9* Student Evaluations 

DOD used local written and performance tests, 

T/TS used local written and perforroance tests 
in addition to personal Judgement, 



10* Percentage course attrition 9 16 

Poor Work 4 5 

Elected to Leave 1 9 

Other * 4 2 

Once again we see the T/TS course Investing heavily in administrator decision 
concerning course revision and evaluation. In this Instance neither DOD or 
T/TS relied on supervisors or on instructors* although they did rely on 
outside (unspacified) information* Student evaluation appeared to follow 
the same format as it has in the general and other single course analyses . 
Attrition also appeared to be fairly similar to other analyses. 

I 
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All in all, this course did not appear to depart drastically from 1- 
what we have seen before in this report. The DOD course was shorter » 
had larger student output, ran more classes and had a smaller class 
size. Training methods Included job equipment and programed texts 
(this was a change from previous findings in this report); The course 
had more instructors, smaller student/instructor ratio and unknot 
eupport people* Evaluation was more formalized and did not involve as 
much administrative or personal opinidn. Finally, atttition was less 
than for thm T/TS course* 

The T/TS course evidenced longer course length, smaller student 
output, fewer classes per year and a larger class size. The course 
depended on lecture, demonstration and simulation In the instructional 
methods. The course had fewer instructors, a larger student/instructor 
ratio and fewer graduates per Instructor, The administrator remained 
the major decision maker along with other unspecified help* Student 
evaluation included more personal Judgement and course attrition was 
larger with jthe greatest percentage electing to leave, 

CONCLUDING REMARKS 

s 

As a final observation on the. study per se, we feel that the com- 
parative situation as presented in the three figures is representative of 
the situation as it was presented through the questionnaire and telephone 
responses. This report highlights the fact that it is imprudent to make 
a special isolated issue out of one statistic or Index comparison between 
military and civilian schools* 
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One very consistent theme throughout the data was the much longer 
course length for the T/TS courses. There are several options for 
eyajluating this outcome. First, If the directory sources we used are 
vaiid in terms of equating output of training, then one can conclude that 
the T/TS course is just not as effttient. Evidence could be found in 
the longer lecture and discussion timei for T/TS as opposed to the Job 
equipment and hands-on training of the DOD» Also, graduates per \ 
instructor would be a secondary da^tum which would lend additional support. 
:0n the fther hand, if one disregards' the overall equivalency of the courses 
as matched up by the catalogues we used then, the issue becomes one of 
asking the question "What is>the training output of DOD and T/TS courses?" 

The thought here would be that T/TS by virtue ofstheit longer training ^ \: 
period either trained students "better" or gave thera more eKtensive 
skills. ^ 

It would appear to us that this second position would refluire some 
evidence that the catalogues which were used did in fact not mat^h up 
courses of equivalent content. This would next lead to a study to 
determine exactly whit the prof iclency of each type of graduate was from 
DOD and T/TS courses. Such an undertaking was quite beyond the present 
study, therefore we elect to utilize our method for selecting courses 
as described in this report until better information is available. 

V - ^ " 

To us, on thewhol^e it did not appear that the military or the trade/ 

technical schools, either one, demonstrate a highly dramatic overall 

advantage over the other in instructional management, course operation, 

evaluation , or staffing. Usually, any one particular advantage 

tended to be offset by other, I^bss complimentary comparisons* 

Most of the issues raised in this study deserve individual attention 
through extended research efforts* A broad based study, such as .this, 
can on ly serve to highlight trends and to sketch out the generai situation. 
It is to be hoped that our findings will encourage further exploration into 
this imporcanc topic. 
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JOB- TRAINING QUESTIONNAIRE 
HpnRRO/DQD Project No. 



I. DESCRIPTION it COKDUCT OF COURSE 
A. Job Title & Course DefnograpKTcs 



*jQb Title I 



E. Course Daiographlcs I Please fill in the following blanks witii 
the appropriate numbers . ^ ^ 

' ■ ■ . i- 

a. Course length in weefcs' - . 'i. ~ 

b. Total number of acad»i1c class hours 

c. Average annual studant input * 
Average annual student output ' . 

a. Number; of classes starting in this course par year ' 
Average starting class size ^ 



g. Range of starting class size: Largest to .Smallest 

h* Number of years this course has been taught ^ 
1. Are the students full-time in training. Yes No 



V If notp What percent of their time is 
^ devoted to training In this course ? ^ 



j\ If the course is partly on-the-job^ what percent 

of the time is devoted to^O^J-T ? ^ 

B. Training Methods Employed in This Course ; 

Please fill in the following bl^;nks with the appropriate percentages 
Course instructional time is diltributed approximately as follows 
across: ' 

1. Instructor»Mediated Methods % of Time 

a. Classroom lectures _ 



b. .Demonstrations (visual & oral) , % 
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* Dictionary ^'f 'Occupational Titles, Deparunent of Labor 



• * ^ • ' , " ' ' fti ^ - ' ^ ■ I Of TImB 



. ♦ 



c. Dl^usstons a ^enlnars 

d. Hands-on sj£llT*pract4ce*' ^ ♦ 



^ ; on actual,, Job e^lpiiitnt & matertils 

* fri. (2) on i^mulftor^ or parl^tisk tra1nt« 



2. * Jlon-lristiructor Ha4i«ted Hethoii* 



b. Audio-visual nodule (vidio e|aperecard1ngs, tapes, 
films, sndes) * *; \ ^ _ _ _ 



c. Mo^-ups, ekhlb^te, displays * 

3. Othtr fSpeelfy; . ) . . ' ' \ • 

: - - • ' . ' ^ - 100% TOTAL 

C. Staff. Asslnned t6 This Course ^ - ;.. ^ . 

Please fill In the fpl lowing blanks with the appropriate numbers 

Prorate and use fractions as necessary. ' . ■ " . ' • 



1. Average number of actuaV primary instructoir^ 
' assigned per ye%r • * 



2, Average nianber of assistant Instructors 

(peer tutors, coaches, teachere aides, etc3 
^ •assigned per year. , . . 



3. Average num^p of the pllowlng overseeing this course per yean 

«> a. Program Administrators • ■ . ■ y^'.. ' ' " - ' . 

b. Supervisors . / ' - _ L_ ' 

c;. Managers " ' ; • •■ • ■ ■ 

I. Averaga nupber of supppi^t peoj^e sen/lcing this ' : ^ 
course (maintenance, magical* housing, elerfcal) ^ . ^ 

per jfear* \ * . ^ ^ - 
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. DEVELOPMENT OF TRAINING 

Was your training staff organized to accomplish the follcNing activities 
during dtvelopmant of this courst? 

If your answer 1$ "yes". Indicate how many of your staff were assigned 
to ©ach activity. Prorate and use fractions if necessary, 

' " ^ No % of Staff 

1. Job & tasfe analysis to determine . 
course content ^ 



2. Development & production of 
Instructional materials 



3, . Development & production of 
K media to support instruction 

4. Development of Instruments for 
assessing student achievement 



5, Development of quality control 
procedures for assessing 
course effectivehess 



6, What was the estimated cost for development of this course? 

If your training staff was not organized as 1n Item A above, were course 
C development activities performed by^ the primary course instructor(s)? 

Yes No 



If your answer is "yes'% how many man- days v/ere used In the development 
of this course? 



What was the estimated cost for development of this course? 



* If neither^A nor B above applys how were course developmental activities 
accomplished? 



Did you buy a packsggd course? Yes Ho 

If yes, what was the cost! • , \ 

Did local civilian trade/ technical advisory groups participate in 
developffltnt of this course? * 

• Yes No 

Has this course been revised?.. • Yes J No 



If so, how often? Jach year __| .Each 2 years i Every 5 years 

Has this course been revised on the basis of: NO , 

1. Feedback fr^ usfrs of graduates ' . . ' ' " •' / 

2. Feedback frOTi graduates themselves 

3. Technological change in the job ■ ' ■ 

4. Recommendations of advisory groups 

5. Standing pbl Icy to update instruction 
periodically . [' 



If you do revise this course* who is the major decision-mak 
inisiiiitar 




Suptrvlsor 
Priinary Instructof' 
Committee 
Outside Expar^t 
Other (Specify) 





in; MrrMODS of course EyALUATION ^ i 




k. Dots your training staff tvaluatt trafning materials? Yts ; No 



If yeSp by which of the following mtthods? 

Personal judgCTitnt^ 
- - Fopmal review 
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St^sequtnt Job ptrfonrance 
Past experience 
Insti tuti ona V pol icy 
Othar (Sptclfy) 



1. In the evaluation mentioned above^ what data are used In making 
the decisions? 



Checklist 

Student parformance ratings 
Student test scores 
Wrtttan opinion 
Othir (Specify) 



B. Does your training staff evaluata^tha course Instructor? Yes ^ No 
If sOp by which of the following methods? 

% 



Observation 
Student rajting 
Student performance 
Written test 
Seniority 
Other (Specify) 
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,/.t. In tht •vitluatlon nentloned in B, what data are ustd In making 
/ • thrdaci lions? * 

Rating scale .," . 

Test srares ' 

Wrtltten observations 

Siipervlsor report 

'7 '^^ Other (Specify) ' 



Does, your training staff (Svalua^i fhi epurse content ustd In this coui 

If ^es, by which of the foJIbftflpftiWf^^ , ^ 

Personal JudgtiMnt ^ ' 

Fornial rtvitw " • 

■ . . Subsequtnt job ptrformance ^ 

^ ^ Past experience 

Institutional poliey .^^ 

Other (Specif . 



l.i In the evaluation mentioned above^ what data are used in making 
the decisions? 

Checklist ^_ 
^ ' StUdilit performance ratings ^ - . 

Student test scores - 



Written opinion , ^ 

Other (specify) ' ^ 



V. EVALUATION OF STUDENTS 



A. What percentage of each pf the fellowing Items fs ttied ii^ defirTRi^ 
the student ' s course grade? / ■ ' ; A ■ • f 

1. Locally developed written examinations V.!? " 

Standardized written exMil nations \ , 

Sr \ocaTTy tfeveToptd piffannsnci tests of Jttb Skll ' ' 

4. Standardized performance tests of job skills : ' 

5. Instruetor Judgermnts oT the student'i pfrpflcfancy 
6* Peer judgeronts of the student s prof;ic<iiney: : > ; 
?• Other (Specify: ^ . ■ - ) ^\'' 



/ TOOl TOTAL 

What is the overall averagB at^ltlon rate Itt this tr^ining^^ 

Of all the students in. tfie course^ vihat percehtv 

. Graduate J / ; % 

, . Are removed fpr/pbor work % 

Elect to leave themselves ^ % 



Must recycTe (remedial wi 
for graduation 



Leave for medical reasons 
Leave for othfer reasons 



% 
% 



100% TOTAL 



C. If your course ha^s a recycle of remedial planj'fjhat is the average time 
required for a student to go through it? 



Does jfour training tiiff assess the overall efflcleticy of this 
training course! ' 

Yes ^ No 



If Yes, hM? 



What art tht principal factors upon which your staff Judgts training 
afflclency? 







, ' '' ' * 

^ — - — ' - - 


— #^ 































■■■ — T — ■ 



How does j^our staff maxi mi za the training afficlancy of your course? 



V. COST ALLOCATWNS 

In this section^ we wish to know how your training resources for this 
course are anocated t'l various categories, VJe need to arrive at an 
approximate total cost for the course. We have broken training costs 
down Into six categories^ Please provide as much detailed infonna- 
tlon^ as possible^ both for direct course costs and -that part of in- 
stitutional overhead charged to each category* J- 4, - 

> ; " * Capital 

This Course^, /This Course Investment 
This Year ; Last Year re TtfiS Course 

FACILITY COSTS - • ^ 

Administrative Offices " ' 



CI assrooms 



Support 

Insti tutiohal Overhead 



EQUIPMENT COSTS 
Office ' 



Classroom 



Lab 



InstruGtlonal Aids 
(projectors, recorders^ 

Institutional Overhead 



INSTRUCTIONAL MATERIAL COSTS 

Audio Visual (films tape, 
etc.) 

Texts 



Workbooks 



Institutional Overhead 




' , T^mt Pep Yia 

PERSONNEL C0S13 This Course This Course In Non^Cours 

This Year Last Year Related Aetlvl 

: * ■ ' 

A^lnistratlon , , • 
Instructional > . , 



^upport 

CONSUMABLS' SUPPLY COSTS 

Office 

Instructor 

Student * ' 

Institutlorial Overhead 

• STUDENT COSTS > 

Wages s If stftdtnts are paid 
(average per student) 

TraveT 

Subsistance 

Medical 

Institutional Overhead 




If you charge a fee for this course^ how much is it per student ? 



If you use CAI^ please Indicate the annual operational cost for this course. 



If you use CMI> please indicate the annual operational cost for this course. 



I v/ould be willing to devote up to 1/2 day for a follow-up interview early ii 
November* 

^ Yes^ No 

O i , '10, . • 

ERIC 



ERIC 



ERIC 



